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ABSTRACT 

Although the mail survey is an efficient method for 
collecting data, its major disadvantage of nonre&jponse ' bias is 
reflected in the number of studies conducted investigating the 
effects of incentives to increase response rates.' Linsky (1975) 
reviewed studies investigating the use of incentives to increase 
mailed return rates and found inconsistencies regarding the efficacy 
of various incentives. The present study used two different 
approaches in an attempt tp' resolve inconsistencies found among 
articles regarding the use 6f incentives to increase mailed survey 
response rates*. It was hypothesized* that a uniform methtod of analysis 
for all articles might resolve the reported inconsistencies. This 
possibility was examined as Experiment I • In addition, it was 
hypothesized that pooling data across studies by summing the number 
of returned and total number of survey questionnaires • at each 
treatment , level might also resolve the reported inconsistencies. This v 
approach was examined as Experiment II. The results of each 
experiment are discussed and a summary of the findings is reported. 
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Abstract 

-It rough the mail survey is an efficient method for 
collecting data, its major disadvantage of nonresponse 
ijias :s ^eT^ected in the' number of studies conducted ; n - 
vest i "g 'a t 1 n g the effects of- incentives to increas p 
re+spcr.se rates. Linsky ( 1 ? 7 5/ reviewed studies in- 
vestigating t^e use of incentives to increase mailed 
r*e turn rates and found inconsistencies r egardmg v h e e f — 
fioacy of various incentives. The present study used two 
different approaches in an Attempt to e s o ] v e in- 
consistencies f c u n ^ a mens sr t n c 1 ^ s ^^^ar^^rs v v> ^ <cp o ^ 
incentives t-0 i^c ^^e ase mailed survey response rat^s. t 
was hypothesized that a uniform method of analysis for 
all articles might resolve the reported inconsistencies. 
This possibility was examined as Experiment 1. In addi- 
tion, *it was hypothesized that pooling data across 
studies by summing the number of returned and total 

number of survey questionnaires at each treatment level 

» 

might also'resolve the reported inconsistencies. This ap- 
proach was .examined as Experiment II. The result^ of each 
experiment are discussed and a summary of .the findings is 
reported . 



Examining the Effects -of Incentives on the Return 
Pates of M ailed 'Surveys 

: f 

The mail survey is an efficient method for collecting 
v. 

data and beca-use a large number of subjects may be sampled, 
it offers a data collection method that may yield greater 
validity through mor e - r epr esenta t i ve samples ( v iller, 19^0). 
However, survey methodology presents the researcher with 
some umcue problems including ncnresponse bias ar^ response 
error. The major disadvantage of the mailed survey is that 
q r ^QnrpcpQrj^p ^'^pq * o *7 q ^ % ^is ^ ^ ^^^"^^c^ted ^ r ^* h e 

fact that.fncst of the studies conducted on mailed survey 
methcdplogy ha»ve ihvestigated the effects of incentives to 
increase r espon se ates . 

Linsky (;9 7 5) reviewed studies investigati/ng the use of 
incentives* to\ increase mailed return rates. Ey tallying 
findings of each* study as significant or nonsignificant, he 
found inconsistencies regarding the efficacy of various 
incentives. However, differing methods of analysis we re em- 
"ployed in the original studies, 'and consequently, it is 
conceivable that the inconsistencies reported were due to 
the differing analyses rather than to any real differences* 
inherent ijn the data, across studies. It was hypothesized 
that comparing the tallied results from each article based 
on the results of a uniform rrjet hod of analysis for all 
articles might resolve the reported inconsistencies. This 
possibility was examined as Experiment I entitled Voting 
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Method. 

The vctirfg method consists of tallying significant N 
versus nonsignificant findings a^id deciding in favor of the- 
-decision outcome receiving t>he greatest number of tallies. 
Because. Glass P9 7 6) and, Light and Smith (1971) have com- 
mented on' the weak inferential value of this approach a 
peeling approach was also utilized. T^e pooling of data 
across studies was accomplished by summing the number of 
returned * and t>otal number of survey questionnaires at each 
treatment level, ""his approach was examined as Experiment 
"II entitled .Pooling v e t h o d , 

Thus, the present study attempts to resolve m- 
consistencies found among^ ar t i cl es regarding the use of 
incentives to increase mailed survey response raters by two 
different methods, the Voting and Pooling methods. The dataa 
fir this study was co'lhec-ted by searching the literature of 
nine professional journals. ^he search ^began with the 1950 
issues, but due to limited availability of several journals 
the years for which they were searched are'listed after each 
journ al : 

Journal of Advertising Research , 1960-1980 * 
Journal of American Statistical Association , 1 950 -1 980 
Journal of Applied Psychology , 1950-1 98/) 
Journal of f^rketing , 1950-1 980 
- Journal of Marketing Research , 1964-1 980 
Printer' s Ink , 1950-1 96 7 

Social Forces, 1950-1980 w 



X 



Sociology and Social Research , 1 95 0-1 980 

Vocational Guidance Quarterly , 1960-1980 

These particular journals were selected -due to their 

demonstrated commitment to publishing articles relevant to 

'design and analysis issues, in survey research. Studies were 

t . 
selected for 'inclusion where incentives were the independent 

variable and survey response rates were the dependent varia- 
ble. To be selected for inclusion studies had to report the 
total number* of subjects and the number arjd/or percentage of 
returned surveys. The rationale for these c ir ter i a' wil 1 be- 
come evident. Eighty studies me^ting^hese criteria were 
originally located with 39 * containing information appropri- 
ate for reaftalysis. The 39 studies were organised in 
homogeneous clusters (Light 4 Smith, 1971'). Th-ese incentive 
clusters were examined separately in Experiments ? /& II and' 



as po st ag e ,^que st i onn ai r e color, personaliza- 



are identifii^ 

tion, preliminary contact monetary, and follow-up mailings 
These six incentive clusters investigated were used because 
they were the <^pes most frequently encountered in the 

y 

literature and f€>i7 which sufficient data were available. 

/ 

Experiment I--Voting Method " i 

' . \ 

.Procedure . 

— ~Z 

fine uniform method of analysis selected was the linear 
and departure frt>m linearity tests for proportional 
ata (Snedecor 4 Cochran, 1967 ). The linear trpnti test was 
selected because when speaking of return rates itN seems ap- 
propriate to speak in terms of increasing trends in the 
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' >K \data. Although most frequently used, Chi Square seems less 
appropriate because it is basefr on tire idea' that if the v 
^hypothesis upon which the expected frequencies are computed 
is correct, deviations of acuta! frequecncies from the ex- 
pected ones will be random fluctuations (Chaise, 1967). 

Table, 1 is a summary of tfte articles that were tallied* 
according to two voting methods. The first procedure listed 
under Original Anal ys is tallied the results as reported in 
the studies. Where analyses were not originally conducted an 
(X) appears ih the appropriate- column. The tallies listed 
under Uniform* An^ly^i s represents the vot i*ft$*jrrethod after 
rearlalysis using the linear trend and departure from linear- 
it y te st s . 
Resul ts 

Ro stage Incentive Cluster . * Both the postage employed 
on the exterior envelope and on the return enyelope have 
been investigated with regard to their incentive value. Only 
thise studies dealing with exterior po stage are included in 
this analysis, duetto the 1 i/hited 'dat a on return £bstag% 
variations. Eight of the original 80 studies located were 
found to c contain data appropriate for reanalysis in this 
postage cluster. v 

Kernan (1971) concluded that neither a personalized ad- 
dress nor first class postage (as opposed to bulk rate 
postage) sigrii f ican tly aflfecteij response rates-. .However , 
(^gampion and Sear ( 1969) and GullaMorn and Gullahorn ( 1 963 ) 
report significant increases for a (regular stamp as compared 
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to metered postage. Vocino (1977) found no incre3se in 
response from a cqmmemora t i ve stamp as compared to metered 
pdstage. kanuk and Berenson (1 975) aptly, conclude that 

these investigations have been conducted with inconsistent 

i 

results. 



Insert Table 1 ^bout Here 



Table 1 presents the results of both voting procedures' 
for the postage data. All of the original investigations 
reported significance with the 'exception of the nonsignifi- 
cant reported by Kernan (1971) (omitting Hensle»y, 197 a and 
Vocino^ 1,977 who did not conduct statistical tests approprr- 
ate to postage treatment levels). However, only Gullahorn 
and Gullahorn (E959 ) and Kephart and Bressler ( 1 958 ) ^repor t 
.data which demonstrate significant linear trends. It is 
interesting to note that the voting method via the original 
analysis suggest that .type of postage increases response 
rates. Upon rean^alysis by the uniform voting, method there is 
reason to question the incentive value of differing types of 
postage. £s can be seen from Tajple 1 none of the 'three 
studies with three or more levels demonstrated a departure 
from linearity, or a significant -1 inear trend, suggesting 
that the trend of responses was best described by a straight 

line with no slope. 

« 

Questionnaire Color Incentive Cluster . The color of the 
paper on which meil survey questionnaires weile printed has 

< 5 



been investigated as a factor irffluencing return rates. Four 
such articles were located in the literature search and,, 
prpvided the data for this cluster; , ' 
* s • The few available Research reports in this area present 
conflicting results (Liasky, 1975). Bender (1957) sum- 
marizes'two related studies by saying that^tye^color of 
questionnaire stationary was ^ineffective in stimulating 
survey returns. Mattesoa (1974), on the othver hand, con- 
cluded thajt tihe -Color of the quest ionnaire w may ipro^ve the 
response rate significantly. In light of the contradictions 
found in this body of literature, a closer examination seeflTs 
warranted. 

Table 1 presents the tallies for bo^h voting 
procedures. In the original analyses only one-of the 
studies (Matteson, 197 2 *) reached significance. The linear 
trend test yielded significant differences (p<.05) for Dun- 
lap^ (1950) data only. It is interesting to note that Gul- 
lahorn and Gullahorn ( 1963 ) and Matteson (1.974) obtained 

indentical nprmal deviate 1 scored ( 7 = 1 . 37 ) , but that Matteson 

* *** * 

originally reported significance , arrcf Gullahorn and Gullahorn 

did not. Both voting procetkires question the efficacy of 

color as an incentive to survey responses. ♦ 

Personalization Incentive Cluster . The level of 

personalization of the mail survey has frequently been in- 

• • • * , 

vestigated as an incentive<to survey response rates. A 
v t 

number of different methods of introducing personalization 
have been investigated including handwritten as opposed to 



typed element?, addressing the respondent try name, minfeo- 
graphed as opposed to ind ividually" typed questionnaire^,, and 
real'-versus 'facsimile signatures. The, most frequently en- 
countered -variation is a comparison of response rates to 
letters addressing the respondent ? by *nfeme (personal) as op- 
* posed to an impersonal Salutation (e. <g . , Dear Student). The 
analysis is -limited to studies comparing ( the personal 
salutation to the impersonal salut-at io*n , because only-th^^se 
treatment levels provided sufficient data for re^Slysis. 

Both Linsky (1975V and Kanuk and Berenson (1975) indi- 
• • * 

j 

cate th'at the evidence .regarding personalization is highly 
inconclusive. Weilbacher and Wal sh < 1 952 ) re-ject the - - 
hypothesis that personalization of letters of transmittal 
wilt positively affect the returns to a mail questionnaire. 
Dillman and Frey (1974) found that personalization not 'only 
increased "response rates significantly in one study, but 
also increased the speed of subjects'* responses in a second 
study. Because of the time and expense involved in 
'personalization, such coptradic tory evidence is of. practical 
concern. The test for departure from linearity was not 
conducted for this .incentive cluster because only two treat- 
ment levels were involved. 

Table 1 lists the ! six studies for both voting 
procedures. The table is reflective of the literature in ' 
general, tljat is, reflective of the 'inconsistency of 
findings reported. The uniform voting procedure offers '<no 
direction ^n resolving the inconsistencies, as the uniform 
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analyses are in line with the original analyses as reported. 

,- PreIimin'ary Contact Incentive C luster .* Thi s .incentive' 

cluster consists of studies which investigate preliminary 

contact with respondents prior 'to their receiving the survey 

questionnaire. Kanuk and Eerenson (1975) indicate that 

* » * ♦ 

results of studies of preliminary contact ha^e^r esul ted ' in 
somewhat inconsistent results. Linsky (1 975 ). reportjs, 
somewhat differently, that prel iminary contact uniformly 
increased survey response rates. Six studies appropr i ateffor 
reanalysis were located dur;ng the literature review -a f nd" 
were included in this incentive cluster. 

The results of both the unifornj and original voting 
procedures are pre sente-ek in Table 1. Again, the uniform 

analysis failed s to alter the outcome of the voting A 

♦ * * * 

procedure. Tn both cases, five studies yielded* significance 

afid one yielded non si gni f i c ance . The suggestion being that 

( 

preliminary contact is an effective method of increasing 



surv.ey response, rates 



Monetary Incentive Cluster . Thi s i ricentrve cluster 

, ■ } ' 

consists- of eight studies investigating the use of monetary. 

. **\ 

incentives enclosed . wi th the mailed questionnaire. ,The *use 
of monetary incentives has generally been found to increase 

9 

survey rpspanse rates although Huck and % 01 eason (1.974) con- 
cluded tha the monetary incentive must be combined with a 
follow-up in order to achieve an acceptable resppnse rate. 
As shown in Tafle 1 both the uniform and original voting 
procedures appear to increase survey response rates. No 
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evidence of ^inconsi sterol: findings exists in the monetary 
incentive cluster. Based on the consistently significant 

' • v 

linear trend, *and .an the nonsignificant departure from 

linearity, one might' conclude that as the monetary value of 

the 'incentive' increases so does the survey return rate., 

* Follow-up Mailing Incentive Cluster . One of the most 

frequently applied >met Ijod s »f or stimulating survey response 

rates is the follow-up mailing, consisting of a "reminder to 

respondents regarding the completion af the questionnaire 
t 

and its return. The .follow-up procedure has been- reported in 
x mar\y forms, 'such as by mail , -telephone , and personal' 

contact. The cluster is ar^ analysis of only those studies 

' f * * 
us ing* mai 1 ing as -a form of follow-up. Seven^such studies of 

the original 80 articles were found to^' report data appropri- 

• * ' /* 

ate for this cluster. 

Linsky (1975) states that the follow-up technique has 

-experienced great sue cess. Kan uk an* Ber en son (1 975) sug- * 

gesl* that the real-' quest ion with regard to, followrups is the 

number 'of follow-ujDS that shoQld.be employed since* follow-* 

ups have t>eten uniformly found to increase the number of » 

returns . . „ - K 1 • 

i 

s The dependent variable to be used for, the analyses 

changed ; from simple percentages of returns to cumulative, 
perpentges of returns. This was necessary because follow-up 
procedures are used only with subjects who initially failed 
to return questionnaires* No departure from linearity was 
performed because* of the cumulative nature of the data. 

~ > % 12 



Table" 1 presents thte fesuks of both voting procedures 

for the follow-up studies. Each of the three studies 

reporting formal analyses in the original investigation were 

significant. The linear trend te§t fpr all studies' 'was also 

( 

signifipant. 4 It would 1 appear that the folldw-up technique 
is Effective ba^ed-on both voting procedures. 



Experiment II — Pooling Method 



P rocedur e" 



^or the purpose -qf ana'lygis by the linear trend and 
departure from linearity tests., the treatment levels were 
arrange^in ascending order basefc on thei'r expected incen- 
tive value. It was assumed that the treatment levels re- 
presented gradation^ of amounts of incentives on a 
continuous scale. Weights were assigned to treatment levels 
(as required by the statistical tests) by level of expected 
incoative value to the respondent. Moderate objections to 
the assig,ned weights should not produce marked differences' 
in the conclusions drawn ffom the a^na^ysis according to 
Snedecor and Cochran (1967). Therefore , the weights are not 
reported here. The. contention jemai^ that as incentives ' 
were increased the proportion of respondents in each treat- 
ment lev.el should have, also increased. ' 

' The data was, then podled attach treatment level and 
the i^Qq^ed data 'was tested"*for linearity and departure from 
linearity. As stated Wfore, th^\pooling of .data across 
studies was accomplished by. summing th,e number of returned 
and total number of survey questionnaires at each treatment 
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level. To control'- for the effects o'T d,iffer,l£g sample sizes 
the. number of total subjects for e^ch sttudy was- set. equal to 
1 60 and ^he percentage of subjects responding was sub-' 
stituted for th-e number of returned responses. This, in ef- 
fec|ft weighted e'ach study equally regardless of the original 

tm sample size. . ^+ ' 1 * ^ 

An implicit assurnpV.ion of combining the poolipg ■ 
procedure and the 'tests for lirtear trend -and departure, j^om 
linearity is that each study be ^represented at each treat- 
ment level. This assumption was met and tests were 

, conducted for the personalization and follow-up incentive 
clusters. However, "the valididty of the Hnear trend and 
departure from linearity test, results are subject* to distor- 
tio,n for th^ monetary, postage,, and preliminary contact 
incentive clusters because not all studies were represented 
'at each treatment* level . For example, as shown in Figure. 1, 
there is fairly equal representation of studies at ^the 

m r v 

" con trol and letter treatment levels^ but ^not at the postcard 
^HBrtelephone treatment levels for the prel imin^al^ coTltac t 
incentive cluster. This lack of equal representation may 
require futher investigation of the*se particular levels; The 
tests are not reported for the questionnaire color incentive 
cluster ( bee ause there was extensile violation of the assump-; 
tion of equal representation. 



1 Insert Figure 1 About Here 
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R es^lts 

Personalization . The data across all. six, studies were 
pooled for- both treatment leAels (form and personal letter). 

c 

The. pooled' procedure yielded nonsigni ficance C Z = 1 . 62 , 
( p> .05 ). 'Figure 2 illustrates* the slope of the- pooled data- 
that is -.not significantly different from zero . ' Bee ause twQ 
points define a straight line, the departure from linearity 
test was not conducted. 



Insert ,Figure 2 About ftere 

. . . - ~~ % 

Each study that was pooled may be examined by drawing a 
line between treatment levels in Figure 2. Doing so ' 
demonstrates why the voting procedures question the con- 
clusion that personalization in uniformly ineffective as a 
survey incentive . However, the pooled analysis indicates 
that on the'witole the added time and expense required for 
personalization are not justified by any uniformly signifi- 
cant increase in survey response rates. 

Follow-up . The data from the seven follow-up studies 
were pooled across studies for reanalysis. As in the voting 
method the dependent variable used for^|^e analysis changed 
from simple percentages of returns to cumulative percentages 
of returns, Aga o in, this was necessary because follow-up 
procedures are used only with subjects who initially failed 
to return questionnaires. 

This linear trend test performed- for the data pooled 



9 

ERIC 1 



across studies yielded a significant linear trend (Z=12.03, 
p<.0J v ) across the four treatment levels analyzed in order of 
their ' inc en tfv§ value (no treatment control, first f ol low- 
Up,- second' follow-up , and third follow-up). This means that 
each successive follow-up yielded d imini shi ngl y greater 
Returns. That is, the first follow-up achieved 1 9% addi- 
tional returns; the second follow-up yi.elded 15? additional 
returns; the third followMip reminder achieved 7? additional 
returns. The dat'a are not presented figuratively because 
each study reflected the Sam* trend as' indicated by both the 
pooling and the voting methods. 

« 

- It is apparent from the data that the follow-up 
procedure is an effective incentive to increase survey* 
f'esponse rates. The number of follow-ups suggested for a 

particular purpose should be decided based on desired out- 

t ■ 

comes and available resources. Based on our reanalysis we 
conclude that more than three follow*-ups would rarely, if 
ever, be of any significant benefit. 

Preliminary Contact . Four treatment levels were en J 
countered in the six studies including a no treatment^ 
control, pVeliminary contact by postcard, preliminary 
contact by letter, and preliminary contact by telephone. 
The treatment level s were arranged' in thi s ord er based on 
their expected incentive value. 

Figure 1 e reports the percentage of returns for each 
treatment ' level . The linear trend observed is significant 
(Z=7 .50, . p< .01 ) . Also, the departure from linearity was 

. 16 ' 
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found to be significant (X, a ,ff (2)=11.92, p< . 01 ) . These ■ 
results indicate that preliminary contact is an effective 
method of increasing survey response rates, and that the 
postcard and letter are nearly equi val ent % in* increasing 
response rates . 

Because the studies are fairly equally represented at 
the control and letter treatment levels there is some* 
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justification for concluding * that preliminary contact in the 

forrp of a letter increases the return rate ov^er no / 

preliminary contact at all. With less certainty we nc^te/that 

a postcard is as effective as a letter but both are*l/ess ef- 

. * fective than preliminary contact by phone. 

.Postage . Six postage^ treatment levels were found in the 

eight studies and included: metered ' post age (third, class), 

regular stamp (first class), commemorative stamp^ niultiple 

stamps, airmail, and special delivery. * Although: not all 

Studies were represented at each .treatment level!, the six 

treatment levels were v/eighted in the above order. 

Upon pooling the data across studies,^ significant 

* . linear trend (Z=5 . 5Q, p< .001 ) was obtained. Further, the 

pooled data 'demonstrates a signi ficant* departure from 
2. 

linearity (X ^f? (U)=20.05, p<.001). The studies are equal- 
ly represented at the metered and regular stamp treatment 
levels. Regular stamps slightly increased the return rates 
over metered postage, however,, there were no significant 
.^differences in return rates for metered, regular and com- 
menorative postag'e. Although these results need to be 

er|c 17 ; 



interpreted wi th- caut ion , the lowest return rate is 
demonstrated when multiple stamps are used, with a sharp 
increase in return rates for airmail and special delivery 
postage. 

Monetary . The eight' studies in this cluster were 1 

grouped by level of monetary incentive. Seven treatment 

« , 

levels were* usecff^ 1 $.00 (no treatment control group), $.01, 
$.05, $. 10, $.25,- $.50, $1 .00. 

When the d^ta across all eight studies were pooled, a 
significant linear trend (Z=3.P7, p<.001) was obtained. The 
p«kpied data also yielded a signvf icarrt departure froto 
linearity (X^ t f^ (5) = 9^.29, p<.001). 

These findings present a problem that is brought on by. 
the violations of the equal representation assumption men- 
tioned ear 1 ier . llo tooney appears to be more effective than 
a $.50 or $1.00 in9entive with the $.25 being most effec- 
tive. However, because $.50 and ll.00\re not equally're- 
presented by, all the studies- (see Figure 3) such a con- 
clusion may be erroneous. Upon examination of the two 
studies at the $1.00 treatment level (Plumberg, et*al., 



1974; Erdos, 1957) it appears that the $1.00 incentive is 
increasing in a linear fa^sh^on , appear ing less effective thin 
$.25 because the return rate for a^l treatment levels in the 
Blumberg, et al. (1974) and Erdos (1957) studies were so 
depressed initially compared to' the others. 



Insert Figure 3 About Here 
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Discussio n * * + 

— n * 

Ths uAiform Voting Method us*e# in Experiment I did lit- 
tle to resolve reported inconsistencies, suggesting as' Glass 
'( 1 976) arid Light an,d Smith (1971) did that the voting 

procedure itself is of little inferential value. -The value 
/ * I 

of the /voting method was limited to its utility *in, 
^organizing, describing and 'd iscussing the original in- 
vestigations. A m x ajor limitation of Experiment II w^s that 
studies were not represented at all possible treatment 
-leveAs in the incentive clusters. " Consequently, at dif- 
ferent treatment levels within the analyses ,^vari^nce wa^ 
attributable to different combinations of studies. However, 
both experiments revealed several .interesting relationships 

.thin incentive clusters. The critical points are sum- 
larized for each incentive cluster as foflows: 

1. Follow-up incentive cluster . Follow-ups are 
without a^ doubt effect! ve in increasing response 
rates. They were foi^d tc^ yield decrea&J njjy fewer 




returns to the third follow-up. The evidence suf 
gests that 'a fourth follow-up would be rarely war- 
ranted. * 
2. Preliminary Contact Incentive Cluster . It, 

r 
J 

seems reasonable to expect higher return rates to a 

'survey if the respondent'^ cooperation ha& f been 

i * 

requested prior to receiving the survey instrument. 
* Perhaps the preliminary contact serves as an incen- 
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ttve to respond in the same manner as a follow-up 
mailing. Although not unequivocally suggested by 
the poo 1 ing" procedure , receiving a commitment to 
respond by tele phone would most clearly insure a 
response. Either a preliminary postqard or^letter// 
are sug-gest ed when the preliminary telephone c^ll 
is too, expensive or otherwise impractical, 
3. Personalization Incentive C luster . A personal 
salutation was found to offer no significant ad- 
vantage to" response rat.es when compared with an J im- 
personal salutation. Perhaps the sur^e^ researcher 
would do well to invest' the extra time and expense 
on an • additional mailing, rather than on 
per son al i zat ion . 

a . Postage Incentive Cluster . T.hird class postage 
is as effective as a regular stamp, a commemorative 
stamp, or multiple stamps, but at the same time is 
less expensive, because airmail and special 
delivery were, not well represented by those studies 
including the other treatment levels, we recommend 
not vconc lud ing that they yield greater returns than 
other postage types. 

4 

5. Monetary Incentive Cluster . That $.25 had a 

\ 

higher response rate than $.50 or $1.00 is believed 
to be a function of the violation of the assumption 
of equal representation. However, whether survey 
response rates increase with increasing monetary 
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incentives remains to be demonstrated. 




ionnaire Color Incentive Cluster . . The * - 



evidence* obtained from both voting methods suggests 
that the effect of questionnaire color is not well 
understood. This problem stems from the fact that 
six of the seven different colors that have been 
examined were addressed in only cfce* study. There- 
at fore the exigencies of a„ par ticul ar sample at a 
■particular treatment level are not federated t^y 
other samples from other st ud ies . We recommend 
using whit^ paper (or the l^ast expensive) until 
more is known . 
There ^s little doubt that the mail survey v?ill 
continue to be a^ major methodology in;-s^ial and ^behavioral 
research* It is the responsibility of Researchers to-begin 
examining tpe use of 'incentives in mailed surveys to 

decrease the threat to validity created by nonrespon-se bias, 
i 

Further studies of incentive variations, such as the ones 

reviewed,, should attend to the effects of treatment combina- 

r 

tions and conditions which maximize response rates with 
specific ^Jtfpulations and for specific purposes. 
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Tallies for the Original and uniform Voting Metnods 
Reported oy Incentive Cluster 
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Figure 1 
Pooled data by Treatment Levels 
For Preliminary Contact Cluster 



XI 
0) 

c 
u 

3 
-P 

« 

-p 
c 

0) 

o 

M 
<D 
CM 



90? 



80% 
70% 



60% 



50% 



40% 



30% 



20% 



10% 



0% 



.Parsons, et al. 



.Waisanen 
.Parsons, et al. 

.Stafford 



•Waisanen .Walker , et al, 

Walker , et al^ «' 

.Heaton 
.Stafford 



.Walker, et al. 



.MyerS, et al, 
.Heaton 

.Stafford 



.Myers, et al. 



Control 



Postcard Letter 



Telephone 



(Z-7.50, p<.01)' 

(X diff (2) = 11#92/ P < - 01) 



1 



ERJC . 



5s 



Figure 2 
Pooled Data by Treatment Levels. 
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Figtflre 3 
Pooled Data by Treatment Levels 

For Monetary Incentive, Cluster 
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